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We investigate the local times of a continuous-time Markov chain 
on an arbitrary discrete state space. For fixed finite range of the 
Markov chain, we derive an explicit formula for the joint density 
of all local times on the range, at any fixed time. We use standard 
tools from the theory of stochastic processes and finite-dimensional 
complex calculus. 

We apply this formula in the following directions: (1) we derive 
large deviation upper estimates for the normalized local times beyond 
the exponential scale, (2) we derive the upper bound in Varadhan's 
lemma for any measurable functional of the local times, and (3) we 
derive large deviation upper bounds for continuous-time simple ran- 
dom walk on large subboxes of Z'' tending to Z** as time diverges. We 
finally discuss the relation of our density formula to the Ray-Knight 
theorem for continuous-time simple random walk on Z, which is anal- 
ogous to the well-known Ray-Knight description of Brownian local 
times. 

1. Introduction. Let A be a finite or countably infinite set and let A = 

{Ax^y)x,y£A be the generator, sometimes called the Q-matrix, of a continuous- 
time Markov chain (^t)te[o,oo) on A. Under the measure IPa, the chain starts 
at Xq = a S a, and by we denote the corresponding expectation. The 
main object of our study are the local times, defined by 
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which register the amount of time the chain spends in x up to time T. We 
have {Iti V) = Jq V{Xs) ds for any bounded function 1/ : A — > M, where (•, •) 
denotes the standard inner product on . We conceive the normahzed local 
times tuple, = {j'^t{x))x£A, as a random element of the set Aii{A) of 
probability measures on A. 

The local times tuple It = {iTix))x&A, and in particular its large-T be- 
havior, are of fundamental interest in many branches and applications of 
probability theory. We are particularly interested in the large deviation of 
y£t- a by now classical result [12, 21] states, for a finite state space A, a 
large deviation principle for j^£t, for any starting point a G A, on the scale 
T. More precisely, for any closed set T C Mi(A), 

(1.2) li^snphogrJhT er)<- inf /^(^u), 
and, for any open set G C A^i(A), 

(1.3) liminf ilogpJi^T G g) > - inf Ia(^). 
The rate function may be written 

(1.4) lAifJ^) = -mi(^(^Ag, | ^ : A ^ (0, oo)|. 

In case that A is a symmetric matrix, lAilj) = Il(~^)"'^''^\//^ll2 equal to the 
Dirichlet form of A applied to y/Ji. The topology used on A^i(A) is the weak 
topology induced by convergence of integrals against all bounded functions 
A — > M, that is, the standard topology of pointwise convergence since A is 
assumed finite. For infinite A, versions of this large deviations principle may 
be formulated for the restriction of the chain to some finite subset of A. 
A standard way of proving the above principle of large deviations is via 
the Gartner-Ellis theorem; see [11] for more background on large deviation 
theory. One of the major corollaries is Varadhan's lemma, which states that 

(1.5) hm llogEje^^((VTy-)] = - inf [/^(^) - F(/.)], 
T->oo 1 ii£Mi{A) 

for any function F : A^i(A) — > M that is bounded and continuous in the above 
topology. We would like to stress that in many situations it is the upper 
bound in (1.5) that is difficult to prove since F often fails to be upper 
semicontinuous. [However, often F turns out to be lower semicontinuous or 
well approximated by lower semicontinous functions, so that the proof of 
the lower bound in (1.5) is often simpler.] 

In the present paper, we considerably strengthen the above large deviation 
principle and the assertion in (1.5) by presenting an explicit density of the 
random variable It, that is, a joint density of the tuple {iT{x))x£A, for any 
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fixed T > 0. We do this for eitlier a finite state space A or for tlie restriction 
to a finite subset. Tliis formula opens up several new possibilities, such as: 

(1) more precise asymptotics for the probabilities in (1.2) and (1.3) and 
for the expectation on the left-hand side of (1.5), 

(2) the validity of (1.5) for many discontinuous functions F, 

(3) versions of the large deviation principle for rescaled versions of the 
local times on state spaces A = Ay coupled with T and growing to some 
infinite set. 

Clearly, a closed analytical formula for the density of the local times is 
quite interesting in its own right. Unfortunately, our expression for the local 
times density is rather involved and is quite hard to evaluate asymptotically. 
Actually, not even the nonnegativity of the density can be easily seen from 
our formula. Luckily, upper hounds on the density are more easily obtained. 
We will be able to use these upper bounds to derive proofs of (1.2) and of 
the upper bound in (1.5) for every measurable set F, respectively, for every 
measurable function F, which is a great improvement. 

This paper is organized as follows. In Section 2, we identify the density 
of the local times in Theorem 2.1, and prove Theorem 2.1. In Section 3, 
we use Theorem 2.1 to prove large deviation upper bounds in Theorem 3.6. 
Finally, we close in Section 4 by discussing our results, by relating them to 
the history of the problem and by discussing the relation to the Ray-Knight 
theorem. 

2. Density of the local times. In this section, we present our fundamental 
result. Theorem 2.1, which is the basis for everything that follows. By 



we denote the range of the Markov chain. Note that given {Rt ^ R} for 
some finite set i? C A, the random tuple {iTix))x£R does not have a density 
with respect to the Lebesgue measure, since the event {irix) = 0} occurs 
with positive probability for any x £ R, except for the initial site of the 
chain. However, given {Rt = R} for some i? C A, the tuple {iT{x))x£R takes 
values in the simplex 



which is a convex open subset of the hyperplane in that is perpendic- 
ular to 1. It will turn out that on {Rt = R}, the tuple {iT{x))x<^R has a 
density with respect to the Lebesgue measure cjt on A4j<{R) defined by the 
disintegration of Lebesgue measure into surface measures, 



(2.1) 



Rt = supp(£t) = {X, : s G [0, T]} C a 



(2.2) 




(2.3) 
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where F : (0, oo) — > R is bounded and continuous with compact support. 

We need some notation. Let i? C A and let a,b £ R. For a matrix M = 
{Mx^y)x,y&k we denote by det^^ (M) the (6, a) cofactor of the R x i?-submatrix 
of M, namely, the determinant of the matrix {lx=/=b^x,y^y=/=a + ^x=b,y=a)x,y£R- 
We write det^b instead of det^^"^^ when no confusion can arise. By di we de- 
note the A X A-diagonal matrix with (x,a;)-entry di^, which is the partial 

( R) 

derivative with respect to Ix- Hence, det^jj, (M + 9/) is a linear differential 
operator of order \R\ — 2 + 5^,6 ■ 

Then our main result reads as follows: 

Theorem 2.1 (Density of the local times). Let A be a finite or count- 
ably infinite set with at least two elements and let A = {Ax^y)x,yeA be the 
conservative generator of a continuous-time Markov chain on A. Fix a fi- 
nite subset R of A and sites a,b £ R. Then, for every T > and for every 
bounded measurable function F : A4^{R) — > R, 

(2.4) Ea[F{iT)l{Xr=b}MR,=R}]= I ^ F{l)p[fil)aT{dl), 

Jm+{r) 

where, for I G M'^{R), 

(2.5) ,i?(/) = deti?(-^ + 5,) / eS...«-^^^v^V^^'<-^^^ n f^- 

(R\ 

Alternative expressions for the density are found in Proposition 2.5 

( R\ 

below. Note that the density p\^^ does not depend on the values of the gen- 
erator outside R, nor on T. The formula for the density is explicit, but quite 
involved, in particular as it involves determinants of large matrices, addi- 
tional multiple integrals, and various partial derivatives. For example, it is 

f R^ 

not clear from (2.5) that p)^^^ is nonnegative. Nevertheless, the formula al- 
lows us to prove rather precise and transparent large deviation upper bounds 
for the local times as we shall see later. As we will discuss in more detail 
in Section 4, Theorem 2.1 finds its roots in the work of Luttinger [29] who 
expressed expectations of functions of the local times in terms of integrals in 
which there are "functions" of anticommuting differential forms (Grassman 
variables). It is not clear from his work that the Grassman variables can be 
removed without creating intractable expressions. Theorem 2.1 accomplishes 
this removal. We also provide a proof that makes no overt use of Grassman 
variables; the determinant is their legacy. 

To prepare for the proof, we need the following two lemmas and some 
notation. We write (p = u -\- \v and cj) = u — iv, where u,v £ M^, and we 
use d^ud^v to denote the Lebesgue measure on x M^. Let = 
ExeA'^^-'V'x be the real inner product on C^. 
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Lemma 2.2. Let A be a finite set, and let M G C^^^. // ?R.{(j),Mc/)) > 
for any (j) G C"^ \ {0}, then 

(2.6) / dA^d%e-<<^'^^^) = -^ 

JrAxra det(A'i 



det(M) ■ 

Remark 2.3. By introducing polar coordinates {1, 6) G [0, oo)^ x [0, 2tt]^ 
via 

(2.7) (t>x = Vrj^^, xgA, 
we can transform 

(2.8) d^?/d^t; = 7rl^l \{ (dl,'^)=2-\^\dHd''e 



and can rewrite (2.6) in the form 

(2 9) [ dH c-^'^'^'^^ = - 

y[o,oo)Ax[o,27r]A (2^)1^1 det(M)' 

Proof of Lemma 2.2. We define the complex inner product (</>,'(/') = 
{(f), ^p). Any unitary matrix U G C"^^"^ defines a complex linear transforma- 
tion on by (p' = U(j). By writing (f> = u + iv and (j)' = u' + \v' we obtain 
a real linear transformation U : {u,v) ^ {u' ,v' ) on © M^. The map U is 
orthogonal, because 

(n', u') + {v', v') = {<P',(P') = ([/(/., UcP) = (0, 4>) = (n, u) + {v, v) . 

Let M* be the adjoint to M so that (</), Mtp) = {M*(j), ip). First we consider 
the case where M = M* . The hypothesis ?R.{(j), M(f)) > can be rewritten 
as (0, M(/)) > 0, so that M has throughout positive eigenvalues A^;, x G A. 
Since M is self-adjoint there exists a unitary transformation U such that 
U*MU = D, where D is diagonal with diagonal entries Dx^x = A^; > 0. Thus, 
by the change of variables {u' ,v') = U{u,v), 

d''ud\e"^'f''^''t'^= f d^^.d^z;e"(*'^<^). 



The integral on the right-hand side factors into a product of integrals 

xeJ^ A AiA. det(M) 

The lemma is proved for the case M = M* . 
Now we turn to the case where M* ^ M. Let 

S=^{M + M*) and A = j^{M - M*). 
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Thus, S and A are self-adjoint and M = S + iA. Also, {(j),S(l)) = Mcj)) 
which is positive by the hypothesis. Therefore the eigenvalues of S are 
strictly positive. 

For n G C we define M{fi) = S + ^A. For /i real, the matrix M{fi) is 
self-adjoint. Observe that M[^) has throughout strictly positive eigenvalues 
when /i = 0. Hence, the real part of the characteristic polynomial of M{^) 
is nonzero on (— oo,0], and therefore bounded away from zero on (— oo,0], 
for = 0. By continuity of the real part of this polynomial in /x, the latter 
property persists to all in a suitable open interval / C M containing the 
origin. Therefore, M{fj,) has throughout strictly positive eigenvalues for all 
/i G /. Thus we have {(p,M{fj,)(f)) > for all nonzero (f> and all fx£ I. 

Now we apply the preceding with M = M{fi), and obtain, for fj- £ I, 

(2.10) det(Af(/i)) J d^ud\e-^'^'^^^''^^^ =7r\^\. 

Both sides of this equation are analytic in /i for SR/i G I because det(M(/i)) is 
a polynomial in fi, and the integral of the analytic function exp{—{<j), M(/i)(/>)) 
is analytic by Morera's theorem and the Fubini theorem, as well as the re- 
mark that 

By analytic continuation (2.10) holds for G / and in particular for = i. 
At ^ = i, M(^) = M. □ 

Lemma 2.4. Let A be a finite set, let M £ C^^-^, and v = {vx)x£A G C^- 
Then, for any continuously differentiable function g : M, 

(2.11) detab{M + di){e<'''-^g){l) = e<''''Uetab{M + V + di)g{l), / G M^, 
where V = {SxyVx)x,yeA denotes the diagonal matrix with diagonal entries 

Vx- 

Proof. By a cofactor expansion, one sees that, for any diagonal 
matrix W, detab{M + W) = J2xcA\{a,b} '^xllxex^x,x for suitable coeffi- 
cients cx depending only on the entries of M. Analogously, detab{M + di) = 
J2xcA\{a,b} ^xd^ , where we used the notation = H^gx ^ix- Therefore, 

e-<^'Uetab(.M + di){e<^'-^gm = cxe-^''''^ df {e^^''^ gm 

XCA\{a,b} 
XCA\{a,b} xeA 

= detab{M + V + di)gil). □ 
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Proof of Theorem 2.1. We have divided the proof into six steps. In 
the first five steps we assume that A is a finite set, and we put R = A. Recall 
the notation in Remark 2.3, which will be used throughout this proof. We 
abbreviate Di = det ab{— A — di). 

Step 1. For any veC^ with E (-00,0)"^, for F{1) = e^''-'^ 

) 

¥.a[F{lT)t{XT=b}\dT 



(2.12) 



/ (AF)(/)e<*'^^> n kf^ 

./[0,oo)Ax[0,27r]A ^^^\ 27r 



Proof. Recall that {v,It) = Jq v{Xs)ds to obtain 
(2.13) = /°'(e^(^+^)),,rfr 



where V is the diagonal matrix with (x,rE)-entry Vx-, and Mx^y denotes the 
(2;,y)-entry of a matrix M. In order to see the last identity in (2.13), we 
note that 

(2.14) r(e^(^+^)),,dr=f re^(^+^)dr') , 

h ' \Jo J a,b 

and that 

poo roo ^ 

(2.15) (A + V) e'^(^+^)dT=/ ^e^i^+'^Ux = -L 

Jo Jo dT 

By Cramer's rule, followed by (2.9), 

(-A - = detab(-A - V) 
^ ^"^^ det{-A - V) 

(2.16) = / det.,(-^ - y)e<^'(^+^W J] ( dl.^ 

= / det.,(-^-y)e('^'')e(<^.^^) [] (dl^^ 

We use Lemma 2.4 with g = 1 and M = A to obtain that 

detabi-A - y)e<^''> = {-l)\M-ie(-'^) det,,(^ + V) 

(2.17) =(_i)|Ahidet,,(A + aOe<''''> 

= detabi-A - d^e^"^'^^ ={DiFm, 
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where we recall that Di = detabi—A — di). Substituting this in (2.16) and 
combining this with (2.13), we conclude that (2.12) holds. □ 



Step 2. The formula (2.12) is also valid for functions F of the form 
(2.18) 



F(/)= n(e"^^^/x(^x)), /.GC2((0,oo)), 



supp(/x) ^ (0, oo) compact, 



^Va, < 0. 



Proof. Note that (2.12) is linear in F and so if we know it for expo- 
nentials, then we obtain it for linear combinations of exponentials. In more 
detail, consider the Fourier representation fx{lx) = J^ fx{wx)e^^'^'"' dwx- Ap- 
ply (2.12) for V replaced hy v + iw with w G M.^ to obtain 



{Die 



{v+iw,l)\^{<f,,A4,) 



[0,oo)'^x[0,27r]A 



Now multiply both sides with Ylx£Afx{wx) and integrate over with re- 
spect to d^w. Then we apply Fubini's theorem to move the d^w integration 
inside. From the representation 

1 



fx{Wx 



2tt 



fx{lx)(i 



dL 



we see that fx is continuous by the dominated convergence theorem. Fur- 
thermore, fx satisfies the bound 



\fxiWx)\ 



1 



2TT{iWx)'^ 

1 1 

27r w'i 



fx{l)S^e-'^^'dl 



dw'i 



me 



dl 



< 



1 1 

27r w'i 



If'Mdl. 



Hence, all functions Wx > fx{wx) are absolutely integrable, and the expo- 
nentials with "Stvx < make the integration over Ix convergent for any x € R. 
□ 



In the following we abbreviate = detab(— ^ + di). 
Step 3. For F as in (2.18), 
(2.19) Ea[F{iT)l{Xr=b}] dT = j F{l)Dte^^'^^^ J] (^^-^ 
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Proof. Comparing (2.12) with this formula we see that it is enough to 
prove that the integration by parts formula 

(2.20) j{DiF)(l)e^'^^^^UH = j F{l){D'le^'^^^^^)dH 

holds for any 9 S [0, 27r]^. Since Di = detafe(— ^ — di) is a linear differential 
operator which is first order in each partial derivative, it suffices to consider 
one integral at a time and perform the integration by parts as follows: for 

any x £ A and any fixed {ly)y£A\{x}i 

(2.21) / {-di^F{l))e^<i''^^Ul,= F{l)diJ'f''^'f'Ul,, x G A. 
Jo Jo 

There are no boundary contributions because the map Ix ^ F{1) has a com- 
pact support in (0,oo). This proves (2.19). □ 

Step 4. For any v £C^, 

(2.22) ^°°E,[e<'''^-)l|;,,=,}l|«,=A}]dr = |e<^'')A*e<<^'^^^n(^^-^)- 

Proof. Let (/n)neN be a uniformly bounded sequence of smooth func- 
tions with compact support in (0,oo) such that fn{t) — > l(o,oo)(0 
Choose F{1) = Fn{l) = nxeA(e''"^"/n(^x)) in (2.19) and take the limit as n ^ 
oo, interchanging the limit with the integrals using the dominated conver- 
gence theorem. Observe that lim.„^oo -^n(^T) = ^^"'^^^ OxeA ^(o,oo)(^t(2^)) = 
g(''>^T> almost surely. Furthermore, lim„^oo -Pn.(0 = ^^^ ''^ almost ev- 

erywhere with respect to the measure IlxeAC^^aj^r)' Thus we obtain (2.22) 
in the limit of (2.19). □ 

Step 5. For all w G C^, 
(2.23) 

r>0, a,beA, 

where pl^\l) is given by (2.5). 

Proof. Recall that J2x£A^Tix) =T almost surely and that J2x£A^oc = 
T for / G A^^(A). Hence, without loss of generality, we can assume that 
5Rw G (— oo, 0)^, since adding a constant C G M to all the Vx results in adding 
a factor of e*^^ on both sides. In (2.22) we replace Vx by f ^ — A with A > 0. 
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oo 

e 



Then (2.22) becomes 



dOx 



(2.24) 



(0,oo)A- 
oo 

' ' dT, 



where 



(2.25) pifil) = I n f^' ^ e (0,oo)^ 



In the second equation, we have interchanged the integrations over I and 9 
and have rewritten the integral using (2.5). In the third equation in (2.24), 
we have introduced the variable T = J2x^x and used (2.3). 

Hence we have proved that the Laplace transforms with respect to T of 
the two sides of (2.23) coincide. As a consequence, (2.23) holds for almost 
every T > 0. Furthermore, (2.23) even holds for all T > 0, since both sides 
are continuous. Indeed, for small h we have {v,£T+h) = {v,£t), Xt+h = 
and Rr+h = Rt with high probability, which easily implies the continuity 
of the left-hand side of (2.23). We see that the right-hand side is continuous 
for T > by using the change of variable t = T^^l and (2.5) to rewrite the 
right-hand side as an integral of a continuous function of T, t on the standard 
simplex A^;^;^-^ (A). □ 

Now we complete the proof of the theorem. 

Step 6. The formula (2.4) holds for any finite or countably infinite state 
space A and any finite subset R of A. 

Proof. It is enough to prove (2.4) for the case F{1) = e^"''^ with ^(v) € 
(—00,0)^ because the distribution of {£t{x))xgR on the event {Rt = R} is 
determined by its characteristic function. 

Consider the Markov chain on R with conservative generator A^^^ = 

(^x,?;)x,j/efl given by 

(2.26) 45 = <^- E ^--J/' if ^ = 2/' 

I y<^R\{x} 
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and let F^^^ be the diagonal Rx R matrix with Vx\l^ = J2y£A\R^x,y Then 

(2.27) 4«J=A,^^ + v;(^) Vx,2/Gi?. 

When started in R, the Markov chain with generator A^^'^ coincides with 
the original one as long as no step to a site outside R is attempted. Step de- 
cisions outside R are suppressed. The distribution of this chain is absolutely 
continuous with respect to the original one. More precisely, 

Ea[F{iT)l{Xr=b}hRT=R}] 

(2.28) =E(«)[F(^T)e-^^^«'-(^)^-"'l{x,=6}l{ii,=/?}], 

T>0,a,beR, 

( T-i\ 

where Eq is the expectation with respect to the Markov chain on R with 
generator A^^\ Applying (2.23) for this chain with e^''''^ replaced by 

(2.29) Fn{l) = F(0e~^-6«'"^"''^' 

and with A replaced by R, we obtain, writing for the restriction of di 
to Rx R, 

E,[F(^T)l{x^=6}l{ii^=ij}]=E(«)[F«(£T)l{x^=fe}l{if^^=i?}] 

(2.30) = / Fn{l)pi'^\l)aT{dl) 



JMtlR) 



IM+[R) 
where 

= e-^^.n^^^^ det,,(-^(«) + d^^^) 

(2.31) 

By Lemma 2.4, followed by (2.27), 

p<i'^)(0 = det,,(-^(«)-y(«)+9;^)) 



7[o,2.]« 4^ 27r 

(2.32) = detab(-^(^) - y(^) + 9p^) 



X 



Ao,2.]H 27r 
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From the definition (2.5), and using (2.7), we recognize the last hne as 
Pah y')- Therefore, by combining (2.32) and (2.30) we have proved (2.4) in 
the theorem. □ 

Now we collect some alternative expressions for the density /J^j, . 

Proposition 2.5. Let the assumptions of Theorem 2.1 be satisfied. Let 
B = ([1 — dx,y]Ax,y)x,y£A be the off-diagonal part of A. Then, for any fi- 
nite subset R of A and for any sites a,b^ R, and for any I G M^{R), the 
following holds: 

(i) 

pfil) = eE..«'^^^,^ detif (-5 + di) 



-'ah 

(2.33) 



X 



J\Q,2-k\R 27r 



[O.^'^J- x&R 
ill) For any r G (0, oo)^, 

pif(0=e^-«'^^^'^detif(-S + aO 

34) 

i[o,2.]« 4^ 27r 

(iii) 

p1?(0=/ ,,detl?(-i? + y,,) 

35) 

^j:.,y,n^^-y^^V^y-'"'-'''T['^ 

11 9-7r ' 



where Vg^i = {Sx^yVg^i{x))x£R is the diagonal matrix with entries 



(2.36) ve,i(x) = E Bx^ fe'^'^'-'-K ^ ^ R- 



The formula in (2.34) will be helpful later when we derive upper bounds on 
Pal, (1) in the case that A is not symmetric. The remainder of the paper does 
not rely on the formula in (2.35). However, we find (2.35) of independent 
interest, since the integral in (2.35) does not involve any derivative. 
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Proof of Proposition 2.5. Formula (2.33) follows from (2.5) by using 
Lemma 2.4. 

We now prove (2.34). Fix r G (0,cx))^ and observe that, for any I £ 
(0,oo)«, 



(2.37) 



[0,2.] « 27r 



11 O-n- ' 



Indeed, substituting 6^^"= = Zx for x ^ R, we can rewrite the integrals as 
integrals over circles in the complex plane. The integrand is analytic in 
Zx £ C \ {0}. Hence, the integral is independent of the curve (as long as 
it is closed and winds around zero precisely once), and it is equal to the 
integral along the centered circle with radius rx instead of radius one. Re- 
substituting r^jc'^^ = Zx, we arrive at (2.37). Comparing to (2.33), we see 
that we have derived (2.34). 

Finally, we prove (2.35). We use (2.34) with r = \fl and interchange 

det)jj (— i? + di) with /jq 2tt]R (this is justified by the analyticity of the inte- 
grand in all the Ix with x £ R). This gives that 

(R)rr^ V UA^^ f J ,(-R)/ n , n \ y ye't^^-"!/) TT d9x 

/'afe (0 = e'^^e^ ' / deV,'{-B + di)e'^^-y'^^ . 

7[o,2.]« 4^ 27r 

Use Lemma 2.4 with g = 1 to see that 

"^t^fe (--D + c'O'S ^'^ = e'^^'fE^ aeV^f^' {-B + Vg), 

where Vg = {Sx,yVg{x))x£B. is the diagonal matrix with entries vg{x) = 

Now we use the same transformation as in (2.37): We interpret the in- 
tegrals over 9x as integrals over circles of radius ^/Q and replace them by 
integrals over circles with radius one. By this transformation, Vg is trans- 

V I B e'f"^"*!') 

formed into Vg^i, and the term e^^^e^ ^ ^'^ is transformed into 

e^^'y^R ^ ^'VV y _ Recalling that B is the off-diagonal part of A, 

(2.35) follows. □ 



3. Large deviation upper bounds for the local times. In this section we 
use Theorem 2.1 to derive sharp upper bounds for the probability in (1.2) 
and for the expectation in (1.5) for fixed T and fixed finite ranges of the 
local times. The main term in this estimate is given in terms of the rate 
function I a- The main value of our formula, however, comes from the facts 
that (1) the error term is controlled on a subexponential scale, (2) the set 
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r in (1.2) is just assumed measurable, and (3) the functional F in (1.5) is 
just assumed measurable. Let us stress that this formula is extremely useful, 
since the functional F is not upper semicontinuous nor bounded in many 
important applications. 

In Section 3.1 we give a pointwise upper bound for the density, in Sec- 
tion 3.2 we apply it to derive upper bounds for the probability in (1.2) and 
for the expectation in (1.5), and in Section 3.3 we consider the same problem 
for state spaces A = At ^ Z"' depending on T and increasing to Z"^. 

3.1. Pointwise upper bound for the density. Here is a pointwise upper 
bound for the density. Recall the rate function 1^ introduced in (1.4). 

Proposition 3.1 (Upper bound for p^f, )■ Under the assumptions of 
Theorem 2.1, for any finite subset R of A, and for any a,b £ R, any T > 
and any I G A4j,(R), 

,(j)(,)<,-T..((i/T)o/^ n 

\xeB\{a,b} V 

(3.1) 

where g E (0, oo)^ is a minimizer in (1.4) for p = ^ '^'^^ 

(3.2) r?ij = max i rnax ^ |S^.,^|,max ^ |S^,^|,lL 

where B = {[1 — 5x^y]Ax^y)x,y£A is the off-diagonal part of A. 

Remark 3.2. If j4 (and hence B) is symmetric, then g = yjji is the 

minimizer in (1.4), and we have lAifJ-) = \\i~A)^^'^ ^/Jj.\\2- In this case the 
upper bound simplifies to 



(3.3) /.l?(0<e-"-«^/-)')f n 

\xeR\{aM V 

The proof of Proposition 3.1 makes use of three lemmas that we will state 
and prove first. 

Lemma 3.3. Let B G [0,oo)^^^ be any matrix with nonnegative ele- 
ments, and let Q C R. Then 

" ' J\0.2.W 27r - ' 

(3.4) 



(0,oo)^, 
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where = n^eg di, . 

Proof. Write e^^.v^R-- =nx,3/e-R^"' ^^"^ expand the exponentials as 
power series. For n = {nx,y)x,y&R G N^^^, we write n\ = Y{x,yi^R'^x,y^-- Then 
we obtain 



1 



(3-5) = E -A 



Q 



(^-Bx^y's/lxy ly) 

.x,y&R 



After rewriting the exponent in the integral on the right-hand side using 
Y.x,y nx,y{6x - Oy) = Y,x ^x^x, where Hx = T,y{nx,y - ny^x), it is clear that the 
integral equals one or zero. Hence, the lower bound in (3.4) is clear, and the 
upper bound comes from replacing the integral by one and a resummation 
over n. □ 

Lemma 3.4. Fix any matrix B G M^^^, let a,b£ R, and let f : (0, oo)-^ 
M be any function with nonnegative derivatives, that is, f{l) > for all 
QCR. Then 

(3.6) \det[f{-B + di)f\<VR n iVR + diJf, 

x€R\{a,b} 

where rjn is defined in (3.2). 

Proof. Recalling that the determinant is the (signed) volume sub- 
tended by the rows, we can bound a determinant by the product of the 
lengths of the rows. This is called the Hadamard bound and it applies to 
any real square matrix. Therefore, for X <^ R and a,b£ X, 

Idetif (-i?)|< n 11^-11 < n VR = ri^R^-\ 
xex\{b} xex\{b} 

where Bx is the row x of B after eliminating the ath column, and || • || is the 
Euclidean length, which is bounded by rjfj because ["^iP ^ (S Also, 

deti^\-B + di)fil) 

E Sign('^) n i-Bx,a.+Sx,aAJfil), 

a:R\{b}^R\{a} xeR\{a} 
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where the sum over a is over all bijections R \ {b} R\ {a}, and where 
sign(a") is the sign of the permutation a:R^ R obtained by letting dx = 
for X and ab = a. Expanding the product, we obtain 



(3.8) 



y: e sign(a)f n ( 

]CR\{a,b} a : Q'=\{fe}^Q'=\{a} \xeQ'^\{b} 

X (l[dAf{l) 



R\iaM \xeQ / 



(3.9) 



QCR\{a,b} \xeQ 

where we write Q'^ = R\Q. Take absolute values and bound the cofactor 
using the Hadamard bound, 

|detifl(-B + 8,)/(;)| 

QCR\{a,b} \x€Q / 

= VR E ( n VR)(l[9L)fil) 

QCR\{a,b} \xe{R\{a,b})\Q ' \xeQ / 

= m n {m + dQf{i)- 

x<^R\{a,b} n 

Lemma 3.5. Fix any finite subset R of A, let B G [0,oo)'^^'^ be any 
matrix with nonnegative elements, and fix a,b £ R. Then, for any T > and 
any I G M.^, 



J[QMR 27r 

(3.10) <ei:....H^-v^^( n xlr^f'' 

\x^R\{a,b} V / 

where rjR is defined in (3.2). 
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Proof. By Lemma 3.4 followed by Lemma 3.3, we obtain 
(3.11) l.h.s. of (3.10) < ?7i? Yl (7?R + 9/Je^-.«e«^"''''^^. 

xeR\{a,b} 

Substitute = ^ £ [0,1] and abbreviate f{t) = e^S-.!/e«'^"'''*"*\ By 
the chain rule, di^ = ^j-dt^. Then 

i.h..of(3.io)<#-' n (i+^i^«0^'" 

x£R\{a,b} 

(3.12) 



\x€R\{a,b} / xeB\{a,b} ^ ^Ty/jT 

where we have used that tx Since all t derivatives (not just the first 
order derivatives) of / are nonnegative since B^^y > 0, we can add in some 
extra derivatives and continue the bound with 

l.h.s.of(3.10)<r?^^|-^(' n f] 

\xeR\{a,b} 

(3-13) X TT /(t) 

\xeR\{a,b} ^/ 

where the last equation follows from Taylor's theorem, and 1/?:/?— > {1} is 
the constant function. 

Recalling that <1, we may estimate 

^logf{t + {2imTr'tR) 

= ^ Bx^ytxty + r, ^ X] ^X,y{tx + ty) + , -2 X/ 

x,yeR ^^^^ x,yGR V^^^^ x,yeR 



<^log/(t) + ^ 



1 1 
— + 



m ' WrT 



x,y£R 



We conclude that 



(3.14) l.h.s. of (3.10) < T^if n - ) /(t)e[''«'+('''«^)"lS-.s«^-\ 
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Resubstituting tx = y/lx/T and f{t) = e ^^,yeR ^ v ^ ^j^g igmma is proved. 
□ 

Proof of Proposition 3.1. Fix any r G (0,oo) and recall the rep- 
resentation of the density in (2.34). Now apply Lemma 3.5 for B = 

{rxBx,yr~^)x,y£R, to obtain 



\xeR\{a,b} 

Now we choose r = Vl/g, where g € (0,oo)^ is a minimizer in (1.4) for 
fi = T^Z. This implies the bound in (3.1). □ 

3.2. Upper bounds in the LDP and in Varadhan^s lemma. In this section 
we specialize to Markov chains having a symmetric generator A and give a 
simple upper bound for the left hand side of (1.2) and for the expectation 
in (1.5). Recall from the text below (1.4) that, in the present case of a 
symmetric generator, /a(^) = ||(— ^)^^^-v/a*||2 for any probability measure 
on A. 

Theorem 3.6 (Large deviation upper bounds for the local times). Let 
the assumptions of Theorem 2.1 be satisfied. Assume that A is symmetric. 
Fix a finite subset S of A. Then, for any T >1 and any a £ S, with tjs as 
in (3.2), the following bounds hold: 



(i) For every measurable T C Mi[S), 
(3.15) 



iogP,( ^eTer,RT<^s 



< -T inf II (-A)i/2^||2 + |5| log{r^sV8~eT) + log |5| + ^. 

(ii) For every measurable functional F:Aii{S) — >M, 

logE.[e^^«VT)..), ]<r [F{^^)-\\{-A)y'^\\l] 

(3.16) 

+ |5|log(775^r) + log|5| + ^. 

Theorem 3.6 is a significant improvement over the standard estimates 
known in large deviation theory. In fact, one standard technique to derive 
upper bounds for the left-hand side of (3.15) is the use of the exponential 
Chebyshev inequality and a compactness argument if T is assumed closed. 
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One important ingredient there is a good control on the logarithmic asymp- 
totics of the expectation in (3.16) for linear functions F. This technique 
produces an error of order e°^'^^ , which can in general not be controlled on 
a smaller scale. 

The standard technique to derive improved bounds on the expectation 
in (3.16) for fixed T is restricted to linear functions F, say F{-) = {V,-). 
This technique goes via an eigenvalue expansion for the operator ^ + 1/ in 
the set S with zero boundary condition. The main steps are the use of the 
Rayleigh-Ritz principle for the identification of the principal eigenvalue, and 
Parseval's identity. This gives basically the same result as in (3.16), but is 
strictly limited to linear functions F. 

Proof of Theorem 3.6. It is clear that (ii) follows from (i), hence we 
only prove (i). 

According to Theorem 2.1, we may express the probability on the left- 
hand side of (3.15) as 

where Tt^r = TT^, and Tfj is the set of the restrictions of all the elements 
of r to R. 

We fix a, 6 G 5 and R S with a,b £ R and use the bound in Proposi- 
tion 3.1, more precisely, the one in (3.3). Hence, for I € M^{R) n Tt,r, we 
obtain, after a substitution I = T/i in the exponent, that 

p(J)(/)<e-^i°W:.upp(.)c«ll(-A)V2^||2/ Yl ^\\^\-^ 



(3.18) 



X el«l[i+(4'7flT)-i] 



Substituting this in (3.17) and integrating over / G Mq^{R), we obtain 

(3.19) < e-^i'^f^er \\{^Ay/^^\\^\R\-l^\R\ll+{4vRT)-^] 

xE E L,^, n J^Mdi) 

bGS RCS:a,bGR-^^T(R) xeR\{a} V 
<g-Tinf^sr|j(-A)V2^|j2^|fihlg|5|[l+(4,,flr)-i]|^|^|S|^|S|-l_ 

In the last integral, we have eliminated la = T — J2yeR\{a} ^y^ have extended 
the {\R\ — 1) single integration areas to (0,T) and used that /q Ix dlx = 
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\/lT . Now we use that r\R is increasing in R and greater than or equal to 
one to arrive at (3.15). This completes the proof of (i). □ 

3.3. Resettled local times. As an application of Theorem 3.6, we now con- 
sider continuous-time simple random walk restricted to a large T-dependent 
subset A = At of Z'^ increasing to Z'^. We derive the sharp upper bound in 
the large deviation principle for its resettled local times. Assume, for some 
scale function T i-^ a-p G (0, oo), that At is equal to the box [—RaT, Rot]"^ n 
Z'^, where the scale function ot satisfies 

(3.20) l<aT< ^ — -] asT^cx). 

VlogT/ 

We introduce the rescaled version of the local times, 

LT{x) = ^iT{[aTx\), xGM-^. 

Note that Lt is a random step function on R'^. In fact, it is a random 
probability density on M'^. Its support is contained in the cube [—R,R]'^ if 
and only if the support of £t is contained in the box [—Rot, -Rot]'^ ^ Z"^. 

It is known that, as T — > co, the family (Lt)t>o satisfies a large deviation 
principle under the subprobability measures V{- H {supp(Lr) C [—R,R]'^}) 
for any R> 0. The speed is Ta^'^ , and the rate function is the energy func- 
tional, that is, the map i— > ^||V(7||2, restricted to the set of squares g"^ of 
L^-normalized functions g such that g lies in iif^(]R'^) and has its support 
in [—R,R]'^. The topology is the one which is induced by all the test inte- 
grals of g'^ against continuous and bounded functions. This large-deviation 
principle is proved in [20] for the discrete-time random walk, and the proof 
for continuous-time walks is rather similar (see also [24], where the proof 
of this fact is sketched). Hence, Varadhan's lemma yields precise logarith- 
mic asymptotics for all exponential functionals of Lt that are bounded and 
continuous in the above mentioned topology. 

Note that this large deviations principle for Lt is almost the same as 
the one which is satisfied by the normalized Brownian occupation times 
measures (see [12, 21]), the main difference being the speed (which is T in 
[12, 21] instead of TaTp^ here) and the fact that Lt does not take values in 
the set of continuous functions — > [0, oo). 

Here we want to point out that Theorem 3.6 yields a new method to 
derive upper bounds for many exponential functionals of Lt- For a cube 
Q C W^, we denote by Mi{Q) the set of all probability densities Q — > [0,oo). 

Theorem 3.7. Fix R>0, denote Qr = [—R,RY and fix tt measurable 
function F : Mi{Qf}) M. Introduce 

(3.21) X = mf{i||V5||i - F{g'):ge H^^''), hh = l,snpp{g) C Q^}. 
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Then 

ryl r r T . 1 1 

<-x, 



(3.22) limsup^logEo 



exp|^i^(^T)|l{supp{LT)CQfl} 



provided that 



(3.23) 

Proof. Introduce 



then we have -^F{Lt) = Ft{j'It)- Hence, Theorem 3.6(ii) yields that 



En 



^^i^T)]t{snpp(LT)cQn} =Eo[exp{rFr(l/r£r)}l{supp(^T)cQfl<,y}] 



where 



Here we used that the two error terms on the right-hand side of (3.16) are 
^o{Ta^ ) g^jj(,g < 2d for any 5 C Z"^ and because of our growth assumption 
in (3.20). Now (3.22) follows from (3.23). □ 

Theorem 3.7 proved extremely useful in the study of the parabolic An- 
derson model in [24]. Indeed, it was crucial in that paper to find the precise 
upper bound of the left hand side of (3.22) for the functional 

F{g^)= i g^{x)\ogg^{x)dx, 
JQr 

which has bad continuity properties in the topology in which the above 
mentioned large deviations principle holds. However, Theorem 3.7 turned 
out to be applicable since the crucial prerequisite in (3.23) had been ear- 
lier provided in [22]. The main methods there were equicontinuity, uniform 
integr ability and Arzela-Ascoli's theorem. 
In the same paper [24], the functional 

F{g'^) = - \g{x)\'^'^dx with some 7 G (0,1), 
JQr 
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was also considered. This problem arose in the study of the parabolic An- 
derson model for another type of potential distribution which was earlier 
studied in [4]. The prerequisite in (3.23) was provided in [24] using tech- 
niques from Gamma-convergence; see [2] for these techniques. 

4. Discussion. In this section, we give some comments on the history of 
the problem addressed in the present paper. 

4.1. Historical background. The formulas in this paper have been moti- 
vated by the work of the theoretical physicist J. M. Luttinger [29] who gave 
a (nonrigorous) asymptotic evaluation of certain path integrals. Luttinger 
claimed that there is an asymptotic series 



for Brownian local times. He provided an algorithm to compute all the co- 
efficients. He showed that his algorithm gives the Donsker-Varadhan large 
deviations formula for cq and he explicitly computed the central limit cor- 
rection Cl. 

In [10] Brydges and Mufioz-Maya used Luttinger's methods to verify that 
his asymptotic expansion is valid to all orders for a Markov process with 
symmetric generator and finite state space. The hypotheses are that F is 
smooth and the variational principle that gives the large deviations coeffi- 
cient Co is nondegenerate. Luttinger implicitly relies on similar assumptions 
when he uses the Feynman expansion for his functional integral. 

Thus there remains the open problem to prove that Luttinger's series is 
asymptotic for more general state spaces, in particular, for Brownian motion. 
As far as we know, the best progress to date is in [5] where compact state 
spaces were considered and the asymptotics including the ci correction was 
verified. 

Luttinger's paper used a calculus called Grassman integration. The back- 
ground to this is that the Feynman-Kac formula provides a probabilistic 
representation for the propagation of elementary particles that satisfy "Bose 
statistics." To obtain a similar representation for elementary particles that 
satisfy "Fermi statistics" one is led in [3] to an analogue of integration de- 
fined as a linear functional on a non-Abelian Grassman algebra in place of 
the Abelian algebra of measurable functions: this is Grassman integration. 
An important part of this line of thought concerns a case where there is a 
relation called super symmetry. This background gives no hint that Grass- 
man integrals are relevant for ordinary Markov processes, but, nevertheless, 
Parisi and Sourlas [33] and McKane [32] noted that random walk expecta- 
tions can be expressed in terms of the Grassman extension of Gaussian inte- 
gration. Luttinger followed up on these papers by being much more explicit 
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and precise about the supersymmetric representation in terms of Grassman 
integration and by deriving his series. 

In [28] Le Jan pointed out that Grassman integration in this context is 
actually just ordinary integration in the context of differential forms. The 
differential forms are the non-Abelian algebra and the standard definition 
of integration of differential forms provides the linear functional. Since in- 
tegration over differential forms is defined in terms of ordinary integration 
one can remove the differential forms, as we have done in this paper, but 
this obscures the underlying mechanism of supersymmetry. The formalism 
with differential forms is explained in [9], page 551, where it is used to study 
Green's function of a self-repelling walk on a hierarchical lattice. Two other 
applications of the same formalism are the proof of the Matrix-Tree theorem 
in [1] and a result on self-avoiding trees given in [8]. 

Luttinger found an instance of a relation between the local time of a 
Markov process on a state space E and the square of a Gaussian field indexed 
by E. The first appearance of such a relation was given by Symanzik in 
[37]. His statement is that the sum of the local times of an ensemble of 
Brownian loops is the square of a Gaussian field. The references given above 
to Parisi-Sourlas, McKane and Luttinger removed the need for an ensemble 
by bringing, in its place, Grassman integration. The paper of Symanzik was 
not immediately rigorous because he claimed his result for Brownian motion 
but it makes almost immediate sense for Markov processes on finite state 
spaces only. Based on this work a rigorous relation between the square of a 
Gaussian field and local time of a random walk on a lattice was given by 
Brydges, Frohlich and Spencer in [6]. Dynkin [13, 14, 15] showed that the 
identities of that paper can be extended to Brownian motion in one and 
two dimensions. In this form, the Dynkin Isomorphism, it became a useful 
tool for studying local time of diffusions and much work has been done by 
Rosen and Marcus in exploiting and extending these ideas, for example, see 
[19, 31]. The relation between the local time and the square of a Gaussian 
field is concealed in this paper in (2.12) which relates the local time i to 
I = 1^1^ where (j) is Gaussian. This is more obvious when (p is expressed as 
(j) = u + w instead of in terms of polar coordinates <f) = \/Ie'^. 

4.2. Relation to the Ray-Knight theorem. Our density formula in Theo- 
rem 2.1 can also be used to prove a version of the Ray-Knight theorem for 
continuous-time simple random walk on Z. The well-known Ray-Knight the- 
orem for one-dimensional Brownian motion (see [35], Sections XI. 1-2, [25], 
Sections 6.3-4) was originally proved in [27, 34]. It describes the Brownian 
local times, observed at certain stopping times, as a homogeneous Markov 
chain in the spatial parameter. Numerous deeper investigations of this idea 
have been made, for example, for general symmetric Markov processes [19], 
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for diffusions with fixed birth and death points on planar cycle-free graphs 
[17, 18], and on the relations to Dynkin's isomorphism [16, 36]. 

The (time and space) discrete version of the Ray-Knight theorem, that is, 
for simple random walk on Z, was also introduced in [27], however it turned 
out there that it is not the local times on the sites, but on the edges that 
enjoys a Markov property. This idea has been used or reinvented a couple of 
times, for example, for applications to random walk in random environment 
[26], to reinforced random walk [38], and to random polymer measures [23]. 

In the present situation of continuous time and discrete space, it turns 
out that the local times themselves form a nice Markov chain. However, a 
proof appears to be missing. In fact, up to our best knowledge, [30] is the 
only paper that provides (the outline of) a proof, but only for the special 
case where the walk starts and ends in the same point. 

We state the result here, but omit the proof. The proof will appear in an 
extended version [7]. We first introduce some notation. For fixed 6 G Z, we 
denote 

(4.1) Tl; = mf{t>0:£t{b)>h}, h>0, 

the right-continuous inverse of the map 1 1— > it{b). We denote by 

(4-2) ^o(M = E^, 

the modified Bessel function. 



Theorem 4.1 (Ray-Knight theorem for continuous-time random walks). 
Let £x defined in (1.1) be the local times of continuous-time simple random 
walk {Xt)tyo on Z. Let 6 S N and h> 0. 

(i) Under ¥o, the process {£rph(b — x))^—q is a time-homogeneous discrete- 

b 

time Markov chain on (0,oo), starting at h, with transition density given by 
(4.3) /(/ii,/i2) = e-'^i"'^2/o(2yM^), /ii,/i2G(0,oo). 

(ii) Under Fq, the processes {£j^h{b + x))^^^^ and {£rph{—x))x£No '^'"^ 

b b 

time-homogeneous discrete-time Markov chains on [0, cxo) with transition 
probabilities given by 

P*{hi,dh2) = e-^^5o{dh2) + e-^'-''\ h-ro{2^hJ^) dh2, 

V "2 

(4.4) 

hi,h2 G [0, oo). 



(iii) The three Markov chains in (i) and (ii) are independent. 
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We note that Theorem 4.1(ii) and an outhne of its proof can be found 
in [30], (3.1-2). This proof uses an embedding of the random walk into a 
Brownian motion and the Brownian Ray-Knight theorem; we expect that 
Theorem 4.1(i) and (iii) can also be proved along these lines. In the extended 
version [7], using the density formula of Theorem 2.1, we provide a proof 
of Theorem 4.1 that is independent of the Brownian Ray-Knight theorem. 
This opens up the possibility of producing a new proof of this theorem, via a 
diffusion approximation of the Markov chains having the transition densities 
in (4.3) and (4.4). Furthermore, we emphasize that our proof can also be 
adapted to continous-time random walks on cycle-free graphs and has some 
potential to be extended to more general graphs. Theorem 2.1 contains far- 
ranging generalizations of the Ray-Knight idea, which are to be studied in 
future. 
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